ON THE CLASSIFICATION OF NON-SELF-DUAL MODULAR 

CATEGORIES 



SEUNG-MOON HONG AND ERIC ROWELL 

Abstract. We develop a symbolic computational approach to classifying low- 
rank modular categories. We use this technique to classify pseudo-unitary mod- 
ular categories of rank at most 5 that are non-self-dual, i.e. those for which 
some object is not isomorphic to its dual object. 



1. Introduction 

This paper is concerned with the classification of modular categories as defined 
by Turaev (see [1]). This problem has been considered in different guises going 
back (at least) to the early 1990s. Some early results are found in the physics 
literature where classifications have been obtained for certain restricted classes 
of modular fusion algebras: the finite rank unital based ring [13] describing the 
tensor product (fusion) rules of a modular category. Gepner and Kapustin [10] 
determined those modular fusion algebras of rank < 6 with very small structure 
constants (e.g. < 1 for rank 6). Fuchs [9] classified those of rank < 3 under certain 
(physically inspired) compatibility conditions, while Eholzer [5] classified modular 
fusion algebras of rank < 4 that are strongly-modular, i.e. the kernel of the modular 
representation is assumed to contain a congruence subgroup. A very recent result 
of Ng and Schauenburg [13J shows that this assumption is superfluous. 

Classifying up to fusion algebras leaves only finite ambiguity due to a generalized 
form of Ocneanu rigidity due to Etingof, Nikshych and Ostrik (see Remark 
2.33]): 

Proposition 1.1. There are at most finitely many braided fusion categories real- 
izing a given fusion algebra. 

It is well known that the number of compatible ribbon structures for a given 
braided fusion category is finite (see e.g. [H]), so that the result holds for modular 
categories as well. 

A recent conjecture due to Wang is: 

Conjecture 1.2. [181 Conjecture 6.1] There are finitely many modular categories 
of rank n for any fixed n E N. 
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In [18] a classification of modular categories of rank n < 4 is given under the 
assumption of pseudo-unitarity (which verifies Conjecture 11.21 for these cases). In 
fact, the cases categories of rank n = 2, 3 have been classified in greater generality 
by Ostrik [T5J [16] . Moreover, the conjecture has been verified (for fusion categories) 
in [7J Proposition 8.38] under the assumption that the global dimension is integral. 

For fixed rank n, the classification breaks naturally into two types: 1) those 
categories for which every object is isomorphic to its dual, and 2) the categories 
for which at least one object is not isomorphic to its dual. The main results of this 
paper provide a classification of pseudo-unitary modular categories of rank n < 5 
of type 2). We choose to focus on the non-self-dual case for several reasons, besides 
the fact that there are fewer parameters than in the self-dual case. Firstly, one of 
the main results used in [18] for the self-dual, rank n < 4 case ([HI Theorem 2.14]) 
does not apply to the non-self-dual case. Secondly, we recover the results of [HI 
Appendix A] for ranks n < 4 with significantly less effort, employing Proposition 
12. II to greater advantage as well as a new general result (Theorem 12 .2p . Finally, our 
approach uses symbolic computation techniques that can be generalized, whereas 
[T8] relies upon (difficult ad hoc) hand computations. 

The problem of classifying modular categories can be viewed in parallel with 
that of classifying finite simple groups, and is an interesting theoretical problem 
from this perspective. Our original motivation for classifying low-rank modular 
categories comes from topological quantum computation [8]. Modular categories 
play a key role in the mathematical description of topological phases of matter- 
the physical systems upon which topological quantum computation are expected 
to be built. See [HI Section 6] for details on this relationship. From a symbolic 
computation perspective, classifying rank n modular fusion algebras corresponds 
to solving a large system of polynomials in three sets of variables: 0(n 2 ) algebraic 
integers, 0(n 3 ) non-negative integers and n roots of unity (of undetermined order). 
For n > 2 the system resists a purely machine computation solution, both because 
of the system's complexity and the essential way in which integrality and Galois 
groups are used. 

Here is a more detailed description of the paper. In Section [2] we obtain some 
general results on integral modular categories and apply them to the classification 
of rank n = 3,4 non-self-dual categories. Section [3] gives the classification of rank 
n = 5 non-self-dual modular fusion algebras. In Section H] we summarize the 
technique and discuss its potential applications and generalizations. 

2. Preliminaries 

A modular category is a finite semisimple C-linear rigid braided balanced monoidal 
category with simple identity object satisfying a certain non- degeneracy condition 
(invertibility of the S'-matrix). For our purposes the precise axioms satisfied by 
a modular category will not be important; we refer the interested reader to the 
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text [T] for details. We shall mostly be interested in the polynomial consequences 
of the axioms, which we will describe below. We assume throughout that 
dim(Xj) > and refer to this condition as pseudo-unitarity . This differs 
slightly from the terminology in [7], but conforms with the assumptions in [TH] . 

Let C be a rank n modular category with inequivalent simple objects represented 
by classes {1 = X , X\, . . . , X n _i}. We will abuse notation and refer to Xi as a 
simple object as this will cause no confusion. The (class of) the object dual to Xi 
will be denoted either X* or Xi*. We denote by Gr(G) the Grothendieck ring of C, 
which is a finite rank unital based ring in the notation of [H] and more specifically 
is a modular fusion algebra. Since C is braided, Gr(G) must be commutative. 

Let 5* denote the S- matrix of C with entries Sy. Notice that we have §oi = 
dim(X), and S 2 = D 2 C where C {j = 5 id * and D 2 = dim(C) = ^dim(Xi) 2 . 
Define ipi to be the character of Gr(G) corresponding to the normalized ith column 
of S, i.e. ipi(Xj) = §ij/ dim(Xj). Observe that these characters are orthogonal 
since the S'-matrix is (projectively) unitary, i.e. 

J2 MXkW*k) = $ij dim(C)/ dim(X) 2 . 

k 

We let K = Q(%) and define Gal(C) := Gal(X/Q). 

We will make extensive use of the following results from [18, Theorem 2.10] 
originally due to Coste and Gannon [3]: 

Proposition 2.1. Let Gal(G) be the Galois group of a rank n modular category 
C. Then 

(1) The action of Gal(C) on K induces an injective group homomorphism 
Gal(G) — > S n acting by permutations of ipi. 

(2) Let o be the image of any element of Gal (C) under the above homomor- 
phism. Then there exists = ±1 such that 

Sj,k £<r(j),<j£k,<jSa(j),cT~ 1 (fe) ■ 

(3) Gal(Q) is abelian. 

Let Ni denote the fusion matrix corresponding to the simple object Xi, that is 
Ni has (k, j)-entry N^- = dimHom(Xj®Xj, X^), so that Xi —>■ Ni induces the left- 
regular representation of Gr(G). We point out that this differs from the notation of 
[TS] in that the fusion matrices Ni are transposed. The {iVj} is a commutative set 
of nxn N-matrices since Gr(G) is commutative. There is an important relationship 
between S and the Ni known as the Verlinde formula, which implies that the fusion 
coefficients N^- are rational functions in the entries of S. This is a consequence 

of the fact that the S matrix simultaneously diagonalizes the family of matrices 
{Ni}. The eigenvalues of Ni are {ipj{Xi) : < j < n — 1} so that the entries of ^ 
are algebraic integers (as the characteristic polynomial of Ni is monic with integer 
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coefficients). From this we see that if ipi is Gal(C)-fixed then s^-/ dim(Xj) e Z. In 
particular if ^ is fixed then C is integral, that is, dim(Xj) is an integer for each i. 
One has the following consequence: 

Theorem 2.2. Suppose C is a modular category of odd rank n such that the only 
self-dual object is 1. Then C is integral. 

Proof. Since complex conjugation interchanges the characters ipi and tp* it follows 
that (1 2)(3 4) • • • (n - 2 n - 1) <E G = Gal(C). Since G is abelian, it follows that 
G must fix -00 hence all dimensions of simple objects are integral. □ 

In the case of integral modular categories we have: 

Lemma 2.3. Suppose C is an integral modular category of rank n. Let pi > P2 > 
• • • > Pn — 1 ^ e ^ e sequence of dimensions of simple objects ordered in a weakly 
decreasing fashion. Then: 

(a) the numbers Xj := dim(C)/(j>j) 2 /orm a weakly increasing sequence of inte- 
gers such that Y^i=i = 1 an d 

(b) z < Xi < (n — i + l)ui where u\ := 1 and u^+i := u^iuk + 1). 

Proof. By [6l Lemma 1.2] dim(C)/ dim(Xj) 2 is an algebraic integer for any modular 
category C so in an integral modular category it must be an ordinary integer. Since 
dim(C) := ^YTi=\V\i we obtain (a) by dividing by dim(C). The lower bound in (b) 
is clear: if some Xi < i then 1/xj > 1/i for each j < i so that Yl]=i ^/ x j > ^> 
contradiction. On the other hand, it is a classical result [12] that if Yli=i = r 
where y± < < • • • < yu are integers then yi < (k — i + l)/r t -_i where ro = r and 
r.j + i := ri — 1/yi+i- So (b) will follow once we have shown that l/r^-i < Wj for the 
special case ro = 1. This is also a classical problem solved in |4j where it is shown 
that l/u m+ i < 1 — YlT=i ^-IVi f° r an y m integers yi. □ 

Remark 2.4. The shifted sequence Ui + 1 is known as Sylvester's sequence, the 
first few terms of which are 2, 3, 7, 43, 1807, . . .. Lemma T2.3I suggests an algorithm 
for finding the possible dimensions of rank n integral modular categories C: we 
look for integers xi < • • • < x n = dim(C) such that 

(1) \Jx n /xi G N for each i 

(2) J2i 1/xt = 1 and 

(3) the Xi satisfy the inequalities of Lemma [2.3( b). 

Unfortunately the Ui increase at a doubly-exponential rate (uq is about 3 million), 
so this algorithm is quite slow for large n. 

The term modular is applied to these categories because the axioms require that 
the matrix S is invertible and, moreover, there exists a diagonal matrix T whose 
diagonal entries [1, 6*i, . . . , n _i] are roots of unity so that 
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(l o ) ~* ^ (o l) ~* T 

induces a (projective) representation of the modular group SL(2, Z). We shall not 
use this fact directly, but we will use the useful relation (see [U Chapter 3]): 

(2.5) OiOjSij = N i*,j dim(X fe )4 

k 

2.1. Ranks 3 and 4. Rank 3 and 4 non-self-dual modular categories have already 
been classified in [18]. We include these cases both for completeness and because 
our proofs are somewhat shorter. Recall that a fusion category is pointed if every 
simple object is invertible. In the pseudo-unitary setting this is equivalent to 
dim(Xj) = 1 for any simple object X%. Pointed modular categories of rank n are 
easily classified up to fusion rules: their Grothendieck rings are isomorphic to the 
group algebra of an abelian group of order n. 

Theorem 2.6. Any rank 3 or 4 non-self-dual modular category is pointed. 

Proof. Firstly, Theorem 12 . 21 implies that any rank 3 non-self-dual modular category 
must be integral. Using Remark 12.41 we obtain only one solution x\ = x 2 = x 3 = 3 
which corresponds to dim(Xj) = 1 for all z-the pointed case. 
For the rank 4 case we have the following ^-matrix: 



(I 


d 


9 


g\ 


d 


X 


a 


a 


9 


a 


h 


h 


\9 


a 


h 


h) 



From the formula Sj^ = e T y) i7 -efe )T s r y) iT -i(M for each r G Gal(C) in Proposition 
12.11 we find that the only solution (respecting orthogonality of the columns S) is 
x = 1, a — —g. Using orthogonality of the columns of S we immediately obtain 
d = g 2 and D = g 2 + 1. Since X 2 = X 3 * and X 3 , we find that dim(X 2 ) dim(X 3 ) = 
g 2 = 1 + mxg 2 + m 2 g + m 3 g where m,i — N% 3 is the multiplicity of Xj in X 2 <8> 
X 3 . Clearly mi = and m 2 = m 3 since X 2 ® X 3 is self-dual. We also have 
dimpTi) dim(X 2 ) = g 3 = nig 2 + n 2 g + n 3 g, where = N{ 2 is the multiplicity of 
Xi in X\ ® X 2 . Now n 2 = mi = since 

= mi = Nl 3 = N 2 2 = 

as X% = X 3 . These facts imply g 2 = 1 + 2m 2 g = nig + n 3 . If g is not integral 
then m 2 > and any linear relation in g over Z must vanish identically, so that 
(1 — n 3 ) — (2m 2 — n\)g = implies n 3 = 1 and n\ = 2m 2 . Next consider dim(X 2 ) 2 = 
g 2 = kig 2 + (k 2 + k 3 )g where ki = N 2 2 . We see that ki = n 3 = 1, and k 2 = m 3 = m 2 
using the symmetries of the AT*-. Thus we have g 2 = g 2 + (m 2 + k 3 )g hence 
m 2 = m 3 = 0. But then we have n\ = 2m 2 = which cannot happen unless g is 
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integral. Since D / g = (g 2 + l)/g is an algebraic integer by P, Lemma 2.1], 1/g is 
an integer so g — 1. Thus we arrive at the pointed case for rank 4 as well. □ 

3. Rank 5 

Now let us assume that C is a modular category of rank 5. A classification 
of all modular fusion algebras of rank N = 5 with bound fusion multiplicities 
N^j < 3 is found in [10]. There are two such with non-self-dual objects. In 
the Kac-Moody algebra (or rational conformal field theory) formulation these are 
realized as S77(5)i and SUityifL?,. Quantum group realizations can be obtained 
as semisimple sub-quotients of Rep{U q {si^)) at q = e 71 " 1 / 6 and Rep{U q {sl^)) at 
q = e 7 " 1 / 7 where in the latter case one takes the subcategory generated by objects 
labeled by integer weights (see [TF] for details). The fusion rules for SU (5) 4 are 
the same as the addition in Z 5 , while the fusion rules for S , [/(3) 4 /Z 3 are given by: 



N 3 = 



(0 


1 








o\ 




(0 





1 





o\ 


1 


2 


1 


1 


1 







1 


1 


1 


1 





1 


1 


1 


1 


,N 2 = 


1 


1 


1 











1 


1 


1 










1 








1 


1° 


1 


1 





V 




v° 


1 





1 


( V 


(0 











i\ 















1 


1 





1 















1 





1 















1 


1 





















v° 





1 


1 















and N4 = N%. We will adopt Gepner and Kapustin's notation and denote the 
corresponding modular categories as SU(5)i and S77(3) 4 /Z 3 . We will show that 
this classification is complete without the assumption Nf^ < 3. 
We first consider the integral case. 

Theorem 3.1. Suppose C is a rank 5 integral modular category. Then C is pointed, 
i.e. Gr(C) is isomorphic to Gr(SU(5)i) = Z 5 . 

Proof. From Remark 12.41 we obtain only two possible solutions: 

Xi = %2 = x 3 = 24 = x 5 = 5 and x± = 2, x 2 = x 3 = x 4 = x 5 = 8. 

The former corresponds to dim(ATj) = 1 for all i, and hence is pointed. The 
latter would be a modular category with four simple objects of dimension 1 and 
one simple object of dimension 2. This can be ruled out in the following way: 
the objects X ,...,X 3 of dimension 1 must be invertible and form a group of 
order 4 so the eigenvalues of A^ < i < 3 are 4th roots of unity. This implies 
that ^ 4 (Xj) = Sj >4 /2 = ±1 for < i < 3, hence s i>4 = ±2 for < i < 3. 
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But J2i I^mI 2 = ^ which is a contradiction. So the only possibility is that C is 
pointed. □ 



Lemma 3.2. Suppose that C is a rank 5 pseudo-unitary modular category with 
X| = X 4 . Then either C is pointed or Gal(C) is is isomorphic to the one of the 
two S 5 -subgroups ((0 1 2), (3 4)) or ((0 1), (3 4)). 



Proof. If ipo is Gal(C)-fixed then C is integral, hence pointed by Theorem 13.11 By 
Theorem 13.11 any rank 5 modular category with two dual pairs of simple objects 
must be integral. We conclude that (3 4) e Gal(C) since complex conjugation fixes 
ipi with % < 2 and interchanges ^3 and ^4. Thus we may assume that Gal(C) is 
an abelian subgroup of Cents 5 ((3 4)) containing (3 4) that does not fix 0. After 
relabeling X\ and X2 if necessary, we see that the only possibilities are those given 
in the statement. □ 



In either case we may assume that the S'-matrix for a rank 5 pseudo-unitary 
modular category with one dual pair is: 



(3.3) 



S 



(I 


d 


f 


(J 


g\ 


d 


X 


y 


a 


a 


f 


V 


z 


b 


b 


9 


a 


b 


h 


h 


\9 


a 


b 


h 


V 



where {d, f, g,x,y, z,a,b} cK, h — /ii + i/i 2 & C\' 
least 1 and algebraic integers. We will denote D 2 = 
Using the symmetries 



I and each of d, f and g are at 
dim(e) = 1 + d 2 + f 2 + 2g 2 . 



N 



j.i 



k* 



where the involution on labels * fixes 1 and 2 and 3* = 4, we obtain the following 
fusion matrices (note that = Nj): 
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(3.5) 



(3.4) 



N 2 



iVi 



/o 1 o o\ 

1 n x n 2 n 3 n 3 

n 2 n A n 5 n 5 , 

n 3 n 5 Hq n 7 

\0 n 3 n 5 n 7 n 6 J 

/0 1 \ 

n 2 n 4 n 5 n 5 

1 71-4 n$ rig rig 
n b n 9 n w n u 

\0 n b rig n u n w J 



/0 1 \ 



(3.6) 



N 3 



n 3 n 5 n 7 n 6 

n 5 rig nu n 10 

1 n 6 nio n i2 n 13 



\0 n 7 nu n i4 ni 2 / 



We find that there is a single class of modular categories with Gal(G) = ((0 1 2), (3 4)) = 
Z 6 (up to fusion rules). Precisely, we have: 

Theorem 3.7. Suppose C has Gal(Q) = ((0 1 2), (3 4)) with X 3 ^ X\ and X 1 
and X 2 self-dual. Then Gr(G) is isomorphic to Gr(SU(3)4/1i 3 ). 

The proof is in several steps, which we outline here: 

Step 1 Use the Galois group and S 2 = D 2 C to determine S in terms of the simple 
dimensions d, f,g. 

Step 2 Use the commutivity of the Ni and certain symmetries of their charac- 
teristic polynomials gleaned from Step 1 to obtain a single Diophantine 
equation in 3 non-negative integer variables a,/3 and 7, and expressions 
for all N^j as polynomials in a, (3 and 7. This uses symbolic computation 
techniques (Grobner bases). 

Step 3 Use eqn. (12. 5p to find a single (reducible) polynomial of degree 3 satisfied 
by 9 2 over the field Q(d). Conclude that 9\ and 9 2 must be (primitive) 
roots of unity of degree 1, 2, 3, 4, 6, 7, 9, 14 or 18. 

Step 4 Consider each case from Step 3 to conclude that the Diophantine equation 
has no solutions unless 6 2 is a 7th root of unity, in which case it has a 
unique solution. 

Consider the S'-matrix in eqn. (13. 3p and suppose that Gal(G) = ((0 1 2), (3 4)). 
Let a = (0 1 2) G S5. From the formula §j t k = ^T(j),T^k,TS T (j),T- 1 (k) for each 
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t G Gal(C) in Proposition 12. 1[ we have the following: 

1 = $0,0 = £l,o-£0,cry> d = Slfl = €2,atQ,aZ 
9 = §3,0 = £3,a£0,ab, X = §1,1 = € 2 ^l,af 
O = §3,1 = ^,cr e l,a9i °> — §4,1 = ^4,cr e l,a9 

b = s 3j2 = e 3i(T e 2j(J a 
From these we have four possibilities: 
Case 1 e , CT = e x , a = e 2 , CT = e 3 , CT = e 4 , CT 
Case 2 e , CT = e 1)(T 7^ e 2 , CT = £3,^ = e4, CT 
Case 3 e , CT = e 2i(7 7^ e 1)(T = e 3i(J = e 4i<7 
Case 4 e , CT = e 3j(T = e 4j(r 7^ e li<r = e 2i<T 

In Case 1, we have y — 1, z — d,x — f,x — b — g. Then S 12 = D 2 C gives us an 
easy contradiction that d + df + f + 2g 2 = 0. 

For Case 2 we have y — l,z — —d, x = —f, a = b = —g. Then from S 2 = D 2 C 
we have d — df + / — 2g 2 = 0, which implies that d + / = df + 2g 2 > df + 2 and 
thus — 1 > (ci — 1)(/ — 1) > 0, a contradiction. 

Cases 3 and 4 are equivalent up to permutation of objects X x and X 2 , so we will 
focus on Case 3. We obtain y — —l,z — d,a — g,b— —g, x = —f. The equation 
S* 2 = D 2 C implies the following: 

1 + d 2 + f 2 + 2g 2 = D 2 
d-df-f + 2g 2 = 
9 + dg-fg + 2gh l = 
3g 2 + 2(h\ + hi) = D 2 
3g 2 + 2h\ -2h 2 2 = 

Without loss of generality, we may assume h 2 > by conjugating if necessary. 
These equations then reduce to 

h 2 = D/2,h 1 = (f-l-d)/2 
D 2 = l + d 2 + f + 2g 2 

d-df-f + 2g 2 = 

which describes a variety of dimension 2. The important facts we obtain are: (a) 
all of the entries of S are determined by d, f and g, which (b) satisfy the important 
relation: 

(3.8) d-df-f + 2g 2 = 

Next we consider the fusion matrices and the Diophantine equations their entries 
satisfy. Let us denote by Pi(z) the characteristic polynomial of iVj. From the S- 
matrix we have: 
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Pl( z ) 
P2(z) 



(z - l) 2 (z 3 + c^ 2 + c 2 z - 1), 
(z + l) 2 (z 3 + c 2 z 2 - Cl z + 1), 
(z 2 + a x z + a 2 )(z 3 + biz 2 + b 2 z + b 3 ) 



where c, = (f/d -d+ 1/f), c 2 = (1/d -f- d/f), a, = -2^/g, a 2 = (\h\ 2 /g) 2 , 
h = g(l/f - 1/d - 1), b 2 = g\l/d - 1/df - 1/f) and b 3 = g 3 /df. 



Observe that each of the cubic factors of pt and (z 2 + a±z + a 2 ) are irreducible 
over Q, since we assume that the Galois group cyclically permutes the three roots 
of each of these cubics, and the roots of the quadratic factor of p 3 are not real. In 
particular, none of /, d or g is an integer. Moreover, we have Q(d) = Q(d, /, g) 
and [Q(d) : Q] = 3. The second statement is a consequence of Q(d)/Q being an 
abelian Galois extension, and the first statement follows from the facts that —f/d 
is a Galois conjugate of d and b\ G Z. 

We obtain several useful relations among the rii by computing the pi and p 2 
directly from Aq and N 2 and comparing coefficients: 

(1) The z 4 coefficient of p 1 is equal to —1 times the z coefficient of p 2 . 

(2) The constant terms of p\ and p 2 are —1 and 1 respectively. 

(3) the z 3 coefficient of p\ is equal to the z 2 coefficient of p 2 and the z 2 coeffi- 
cient of pi is equal to —1 times the z 3 coefficient of p 2 . 

(4) The only linear factors of p\ and p 2 are (-2 — 1) and (-2 + 1) respectively. 

For example, the last observation implies that n 6 = n 7 + 1 and n u = n w + 1. 
The resulting relations among the n» together with those implied by the pair- 
wise commutivity of the Ni yield two useful results (using Maple's Grobner basis 
algorithm): 

(1) All entries can be unique expressed as polynomials in t := nio,f := ri\ 2 
and u := nu and 

(2) u, v and t satisfy the Diophantine equation 



(3.9) 



(v + u)((2t - l)u - (2t + 3)v) + 4t 2 + 2t + 1 = 
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Explicitly in terms of u, v and t the fusion coefficients are: 

2t (2 + (u - v) 2 ) + (u-v) (u 3 - u 2 v + 3u- v 2 u + 5v + v 3 ) 

2 ' 

u 2 - v 2 + 2t, 

((u + v)(u- v) 2 + 3v + u) + 2t(u - v) 

2 ' 
2t + 1, n 5 = u + v , 

l/2(u 2 - v 2 + 2t + 1), n 7 = l/2(u 2 - v 2 + 2t - 1), 
t(2 + (u- vf) + 2v 2 - 2uv + 1, 
t(u — v ) + 2t>, nio = t, nn —t + 1, 

V, 7ii3 = f , ni4 = It 

Observe that eqn. (13.91) is an indefinite binary quadratic form for fixed t with 
discriminant 4(2£ + l) 2 (a square) and for any t there are at most finitely many 
solutions. It appears that there are infinitely many integers t > for which (13.91) 
has solutions in u and v. For it = we have the unique (non-negative) solution 
u — 1, v — 0. We will eventually show that this is the only solution that is realized 
by a modular category. 

Next we describe the relations among the integers u, v and t and the algebraic 
integers d, f and g. These come from the fact that ipo = [1, d, f, g, g] is a simulta- 
neous eigenvector for the iVj with eigenvalue dim(Xj). That is: 

(3.10) JViV>o = #b, A^ = /^o, iV 3 V>o = #o 

The variety described by the vanishing of the ideal generated by eqns. (13. 8p . (13.91) 
and (13.101) is 2-dimensional, so these are not sufficient to determine all of u, v, t, d, f 
and g up to finitely many choices. 

Next we analyze eqns. (12.51) . Since X| = X4 we have that #4 = 83, so that eqns. 
(12.51) introduce 3 new variables 6\, 62 and 6*3, which are roots of unity. We obtain 
the following six equations from (12. 5ft : 



(3.11) -]B\ = l + n 1 d9 1 +n 2 f6 2 + 2n 3 g9 3 

(3.12) -0i02 = n 2 d6 1 + nJ6 2 + 2nr o9 6 3 

(3.13) gO^ = n 3 de l + n 5 f9 2 + (n 6 + n T )ge 3 

(3.14) -g6 2 6 3 = n 5 d6 1 +n 9 f6 2 + {n 10 + n 11 )g6 3 

(3.15) d9j = l + n 4 d6 1 + n 8 f6 2 + 2n 9 g9 3 

(3.16) (f-d-l)6 2 3 = l + (n 6 + n 7 )de 1 + (n n +n 10 )fe 2 + 

(2n 12 + n 13 + n 14 )g6 3 



The last equation comes from s 3t3 + §3^ = 2h\ = (/ — d — 1). 

Before proceeding, we note that taking eqns. (I3.8IUI3.10I) and (I3.11H3.161) to- 
gether with the assumptions t = 0, u = and v = 1 imply the following: 



m = 

n 2 = 

n 3 = 

7T-4 = 

n 6 = 

n 8 = 

n 9 = 

nu = 
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9% + 9\ + 9\ + 9\ + 9\ + 9 2 + 1 = 0, 9 X = 91 9 3 = 9 2 

and 

d 3 - 3d 2 - 4d - 1 = 0, / 3 - 4/ 2 + 3/ + 1 = 0, # 3 - 2g 2 - g + 1 = 0. 

Since t — and eqn. ( 13. 9p imply it = 1 and v = we see that if we show that 
the relations (13. 9p . (13. 8p . (13.101) and (13.1 1113. 16]) together with assumptions that 
the 9i are roots of unity and u, v and t are integral force t = 0, then Theorem 13.71 
will follow. 

With this in mind, we first wish to bound the degree of the root of unity 9 2 . We 
claim that 9 2 satisfies a polynomial of degree at most 2 with coefficients in Q(d). 
We use < Kl2lf to solve 

0i = (nJ9 2 + 2n 5 g9 3 )/(9 2 + n 2 d) 

which is possible since 9 2 + n 2 d = 9 2 + {u 2 — v 2 + 2t)d ^ since |<i| ^ 1 and \9 2 \ ^ 0. 
We then eliminate 9\ from the remaining 5 relations and take their numerators. 
Under this substitution (13.141) remains linear in #3 so that we may solve 

„ f02(n 9 9 2 + n 9 n 2 d - n b dn 4 ) 

g{9\ + (rin + n w + n 2 d)9 2 - 2n\d + n u n 2 d + n 10 n 2 d) ' 

If the denominator of this expression vanishes then 9 2 satisfies a monic degree two 
polynomial with coefficients in Q(d) and the claim follows. 

Otherwise, we may eliminate #3 from the remaining 4 relations to obtain poly- 
nomials in Q(d)[9 2 }. By factoring these polynomials and removing spurious factors 
(such as 9 2 + n 2 d) we get two polynomials of degree 4 (from (13.131) and (13 . 1 5|) ) 
and two polynomials of degree 5 (from (13.111) and (13.161) ). Expressing the coef- 
ficients of the two degree 4 polynomials in terms of d,f,g,t,u and v and reduc- 
ing modulo the ideal generated by eqns. (I3.9p . (13. 8p and (I3.10p these become 
(u + v)9 2 + ■ • • + d 2 (u + v ) and d9 2 + ■ ■ ■ + d where the omitted terms are too long 
to include here. We cancel the 9 2 terms to obtain a polynomial of degree 3 in 9 2 
with coefficients in Q(d) with constant term d(d 2 — l)(u + v) 7^ (since u and v 
cannot both be zero as otherwise (I3.9P has no integer solutions for t). 

Since 9 2 satisfies a (non-zero) polynomial of degree at most 3 over Q(d), we 
see that m := [Q(9 2 ,d) : Q(d)] G {1,2,3}, which is a Galois extention since 9 2 
is a root of unity. We can immediately eliminate m = 3 since the degree of the 
non-trivial cyclotomic extension I := [Q(#2) : Q] cannot divide 9. Thus the claim 
follows so that t G {1,2,6} hence 9 2 must be a primitive root of unity of degree 
s G {1, 2, 3, 4, 6, 7, 9, 14, 18} Moreover, since 9 3 G Q(0 2 , d) and 9 X G Q(0 3 , 9 2 , d) the 
same is true of 9\ and 9 3 . 

We can now proceed to Step 4. We systematically eliminate all possibilities 
except s = 7. The strategy is as follows: 
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(a) Let J be ideal generated by eqns. 1ET5]) . flTTBjl . (IOD)l . fla.lllia.16p and 
<yj s (6 l 2)-the cyclotomic polynomial whose roots are primitive sth roots of 
unity. 

(b) Compute a Grobner basis for J with respect to the lexicographic order 
induced by d < f < g < Q\ < 9 2 < 3 < u < v < t. 

(c) Factor the first polynomial in the output of step (b), which will be a poly- 
nomial in v,t or just t. 

(d) Conclude that no integer solutions exist (by parity arguments, for exam- 
pie). 

We consider each case in turn. 

Case 3.17. Assume that s — 1, (i.e. 6 2 = 1). Then we find that at least one of 
the following three polynomials must vanish: 

(2£+l)(6t + l), 

16(1 + t) V + (4(2t - 1)(1 + t)(t 2 -At- 2))v 2 + (At 2 + 2t + l)(t 2 - t + l) 2 , 
6Av 4 + (104 + 32t 2 - 128t)v 2 + (7 - lOt + 4t 2 ) 2 

Clearly the first expression cannot be zero, while the latter two are odd for t G Z 
hence have no solutions. 

Case 3.18. Assume that s = 2. Then the Grobner basis computation gives us 
the consequence: (2t + 1)(6£ + l)(4t 4 + 8t 3 + 5t 2 + t — 1) = which clearly has no 
integer solutions. 

Thus we see that 9 2 cannot be real. 

Case 3.19. Now suppose s — A. Then we obtain a polynomial with irreducible 
factorization: 

(2t + l)(At 2 -At- l)(4t 6 + 12t 5 + 7t 4 - 6i 3 - lit 2 - 6t - 1) 

which clearly has no integer roots (or note that it is an odd number for any integer 
t). 

Case 3.20. If s = 3 then t, v must satisfy: 

(1 + 7t + 16t 2 + 18t 3 + 9t 4 )(4t 2 + 2t + 1 - 8i; 2 ), 
for which both factors are odd for integer t, v. 
Case 3.21. If s = 6 then t must satisfy: 

(8t 2 -At- l)(128t 8 + 512t 7 + 904t 6 + 920t 5 + 573t 4 + 210t 3 + 36t 2 - t - 1) 
which again we see is an odd number for any integer t. 
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Case 3.22. If s = 7 then * must satisfy 

*(1 + *)(8* 3 + At 2 -At- 1)(8* 3 - 12* 2 - 8* - l)Pi 8 (t) 

where Pi$(t) is a polynomial of degree 18 that takes odd values. We conclude that 
in this case * = is the only non-negative integer solution. We have seen that 
* — implies 62 is a 7th root of unity, so this uniquely determines all n i; d, f and 
g as well as 9\ and #3 up to the particular choice of a 7th root of unity 62- 

Case 3.23. If s = 9 then * must satisfy the following polynomial modulo 2: 

(* 6 -* 3 + l)(* 6 + * 4 + * 3 + * + l), 

which is clearly odd. 

Case 3.24. If s — 14 then t must satisfy: 

(8t 3 + At 2 -At - l)(64t 6 + 192t 5 - 208t 4 - 64t 3 + 32t 2 + 12* + l)Qu(t) 

where Q24.it) = 2 12 * 24 + ■ ■ - + 2 3 . The first two factors are clearly odd and so cannot 
be zero. Any non-negative integer roots of the polynomial Q24{t) must be 1,2,4 
or 8 by the rational-root theorem, each of which can be eliminated. 

Case 3.25. If s = 18 then * must satisfy: 

(24* 3 -6t- 1)(64* 6 - 192* 4 - 32t 3 + 36t 2 + 12* + l)R^(t) 

where i?24(*) is a polynomial of degree 24. Each factor takes odd values for integral 
*, so there are no solutions. 

This completes the proof of Theorem 13.71 

Theorem 3.26. The category with Gal(C) isomorphic to ((0 1), (3 4)) does not 
exist. 

Proof. Consider the S-matrix in eqn. (I3.3P and let a = (0 1) G S5. From the 
formula Sj^ = e T (j^ T ek >T s T (j^ iT -i^ for each r 6 Gal(C) in Proposition 12.11 we have 
the following: 



(3.27) 


1 — s 0,0 — e l,a e 0,a x 


(3.28) 


b = § 3 ,2 = e 3ta e 2 ,ab 


(3.29) 


f = §2,0 = £2,at0,ay 


(3.30) 


V = §2,1 = e 2 ,^X,fff 


(3.31) 


9 — £3,0 = e 3,(T e 0,cr a 



Then we notice two facts. One is eo,cr = ei )t7 from (I3.29|) and (I3.30p . and thus 
x = 1 from (13.27p . The other is: provided b 7^ 0, 62,0- = from (13.281) . thus 
e 2,o-£o,a = £3,^0,0-, which means we have two possibilities: y = f and a = g, or 
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y = —f and a = —g from (13.29}) and (13.31!) . If b = 0, (13.281) gives no information, 
and the analysis is more delicate. 
We first assume that b ^ 0. 

For the case that y = f and a = g, we have an easy contradiction as follows: 
S 2 = D 2 C implies that 2d + f 2 + 2g 2 = which contradicts d > 0. 

Now we consider the other case that y = — / and a = —g. The gives us the 
following: 



(3.32) D 2 = 1 + d 2 + f 2 + 2g 2 

(3.33) 2d = f + 2g 2 

(3.34) f(d-l-z) = 2gb 

(3.35) D 2 = z 2 + 2(6 2 + f 2 ) 

(3.36) 2(# 2 + h\ - h\) + b 2 = 

(3.37) g(l-d + 2h 2 ) + fb = 

(3.38) 2fg + zb + 2bh 1 = 

(3.39) 2(g 2 + hl + h 2 ) + b 2 = D 2 



From (13.321) and (I3.33f) we obtain D — d + 1 (assuming D > and d > 1). By 
replacing S by its complex conjugate if necessary, we may assume that h 2 > so 
that (I3.36P and (13.391) imply h 2 = D/2. To derive further consequences of these 
equations we use Maple's Grobner basis algorithm with a monomial order that 
eliminates D and g. One consequence is: 

(3.40) (2/ii(D - 1) + 2g 2 + D - D 2 )(2h - 2g 2 + D) = 

so we have two possibilities: hi = ~ 2g 2 ~j^~ D , or hi = g 2 — y. 

For the first case, we obtain as a consequence (l — D + g 2 )(fg + Db — b) = 0. The 
first factor is non-zero since (I3.33|) implies D — 1 = d = g 2 + ^f 2 so D > 1 + g 2 . 
Thus we must have fg = b{\ — D) = —bd. Notice that j = — | are both integers 
so that — | = <r(— §) = (?. We have a contradiction d = —1. 

For the other case, we obtain (1 — D + g 2 ){fg — b) = which implies fg — b 
from the same reasoning as above. This means that g = j is an integer. Since a 
permutes the roots g and — | we get d = — 1. 

We are left with two remaining cases: 6 = and (Case 1) y = f and a = —g or 
(Case 2) y = —f and a = g. Although these cases can likely be eliminated without 
resorting to symbolic computation techniques, we follow the strategy used in the 
proof of Theorem 13.71 to further illustrate its efficacy We first consider Case 1 as 
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it is slightly more involved. The S'-matrix is: 



(I 


d 


f 


9 


g\ 


d 


1 


f 


-9 


-9 


f 


/ 


z 








9 


-9 





h 


h 


\9 


-9 





h 


h) 



Clearly g cannot be an integer, since Gal(Q) interchanges g and —g/d. similarly, 
/ G N if and only if d G N if and only if d — 1. The equation S 2 = D 2 C 
immediately implies: 

(3.41) z = -(l + d) 

d — 1 

(3.42) h = — 

(3.43) d = g 2 - f/2 

Notice that if d = 1 then z = —2 and z/f G Z implies / = 1 or / = 2. But eqn. 
(13.431) and the fact that g 2 is an algebraic integer imply that if d or / are integral, 
then d = 1, / = 2, g = \f?>. We will consider this case seperately; for now assume 
that d is not an integer. 

Next we consider the Diophantine equations satisfied by the entries n« of the 
fusion matrices N%, N2 and A^3 from (I3.4H3.6I) . In this case we have a common 
integer eigenvalue for the iVj, namely ip2 — (1> 1, —m, 0, 0) where m = (d + 1)//. 
Besides the commutation relations, we have relations obtained from the charac- 
teristic polynomials and the relations involving m. We also obtain 

(n w - n n )(m + n 10 - n n ) = (n 6 - n 7 ) 2 -1 = 

from the fact that the only integer eigenvalues of N\ are ±1 and the only integer 
eigenvalues of N 2 are and — m (provided d ^ 1). From these relations we can 
solve for all of the iVj entries and m in terms of four variables u := n 8 , v := nn, 
t := ni3 and w := nu which satisfy the three relations: 

(t - w)(t 3 + t 2 w + 2t- 2tv 2 - tw 2 + 2wv 2 + 2w- w 3 ), 
(t — w)(—3vw — vt + ut + uw), 
2 + t 2 - w 2 + 2uv - Av 2 . 
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Unfortunately these Diophantine equations appear to have many solutions. We 
proceed to analyze the relations implied by eqns. (12.51) : 

(3.44) 9 2 1 -l-n 1 d9 1 -n 2 f9 2 -2n 3 g9 3 , 

(3.45) 9,9 2 f - n 2 d9 x - nJ8 2 - 2n 5 g9 3 , 

(3.46) e 1 e 3 g + n 3 de x + n 5 fe 2 + k + m) g e 3 , 

(3.47) n 5 d9i + n 9 f9 2 + (n 10 + n 11 )g9 3 , 

(3.48) 6 2 2 (d+l) + l + ndOi + n 8 f6 2 + 2n 9 g9 3 , 

(3.49) 9 2 3 (d - 1) - 1 - d6 1 {n 7 + n 6 ) - fe 2 (n u + n w ) - g9 3 (2n 12 + n l3 + n 14 ) 

as well as the relations implied by the common positive eigenvector By combin- 
ing the relations involving Oi as well as the ^-matrix and Ni entries we immediately 
obtain Q\ = 1. From this we are able to eliminate 6 3 (assuming ^ 0, which 
implies d = 1) and find a polynomial of degree two in 9 2 with coefficients in 
Q(d) = Q(d,f,g). Thus [Q(0 2 ) : Q] G {1,2,4} so that 6 2 has degree 1 < k < 6 
or k G {8, 10, 12}. Using a Grobner basis algorithm with pure-lexicographic order 
d<f<g<---<t<woia the full set of relations together with the appropriate 
cyclotomic polynomial in 6 2 , we eliminate each of these cases in turn. In each 
k > 3 we obtain as a consequence a product of irreducible polynomials of degree 
at least 2 in w with the Diophantine equation (t — w) 2 + 4, which has no solutions. 
In case fc = 1,2 we obtain d — 1. 

So as soon as we rule out d — 1, we are done with Case 1. We find that in this 
case we have: 

n 1 = n 2 = n 3 = n 5 =n e = n 9 = n 12 = n 13 = n u = 0, 
n A = n 7 = n 8 = n w = n n = 1. 

From (I3.47P we immediately obtain 6 3 = 0, a contradiction. 
Case 2 is similar, but slightly easier. Here we have S'-matrix: 

(Id f g g\ 

d 1 -/ g g 

S= f -f z 

9 9 h h 

\9 9 h h) 

Since Gal(C) interchanges 0o an d 4>i we see that in this case if any of g, f or d are 
integral, / = 0, a contradiction. The rest of the proof is essentially the same as 
for Case 1: one finds that 9\ = 1 and [Q(#2) : Q] must be 1, 2 or 4 polynomial over 
Q. Going through the cases one finds that there are no integer solutions. □ 

4. Conclusions and Future Directions 



We briefly describe how our computational strategy can potentially be employed 
to classify modular categories of fixed (low) rank n, or at least verify Conjecture 
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II .21 for n. First one classifies the integral modular categories, perhaps using Lemma 
12.31 Next one determines all abelian subgroups of S n that do not fix the label and 
considers them case-by-case. From Proposition ^. H and the equation S 2 = D 2 C one 
determines the form of the ^-matrix, eliminating as many of the S-matrix variables 
as possible. Many cases will be eliminated in this way. For each remaining case, 
one uses the fusion matrices and the coefficients of their characteristic polynomials 
to obtain Diophantine equations and eliminate integer variables using a Grobner 
basis algorithm. From relation (12.51) one determines the possible degrees of the 
roots of unity 0j. Finally one uses the relations among the S- matrix entries, the 
fusion multiplicities and the 9i together with assumptions on the degree of the 9i 
to obtain new Diophantine equations. These new Diophantine equations will often 
give finitely many solutions. 

In this work we have classified (the Grothendieck semirings of) modular cate- 
gories under the restrictions: 1) some object is non-self-dual, 2) the dimensions of 
simple objects are positive and 3) rank < 5. The strategy described above does 
not require any of these restrictions, and we make some remarks on the complexity 
of removing these restrictions. 

(1) To classify rank 5 non-integral pseudo-unitary self-dual modular categories 
one must consider around 9 Galois groups, only two of which are known to 
be realized for a modular category. 

(2) The pseudo-unitarity assumption can probably be removed without loss 
of generality for rank < 5, although this assumption is often physically 
justified. For rank 6, it is known that there are modular fusion algebras 
that have no pseudo- unitary realization (see [17]) but are realized as Gr(G) 
for a modular category C nonetheless. 

(3) In rank 6 one encounters product categories, and at least 9 modular fusion 
algebras are known to exist. The (two) known non-self-dual examples are 
products of the unique rank 3 non-self-dual fusion algebra with each of the 
two rank 2 fusion algebras. Under assumptions 1) and 2) the classification 
could likely be carried out to rank 7 using our methods. 

Finally, while the assumption of modularity seems critical to our approach, 
analogous results can presumably be obtained for pre-modular categories, in which 
one omits the invertibility of the 5-matrix. Bruguieres [2] has shown that if a 
pre-modular category fails to be modular then two columns of the S"-matrix are 
proportional so that Galois group identities might still be obtained. Moreover, 
eqn. (12. 5p and various other identities hold generally in a pre-modular category 
so that a computational approach is still viable. 

References 

[1] B. Bakalov and A. Kirillov, Jr., Lectures on Tensor Categories and Modular Functors, 
University Lecture Series, vol. 21, Amer. Math. Soc, 2001. 



NON-SELF-DUAL MODULAR CATEGORIES 



1!) 



A. Bruguicrcs, Categories premodulaircs, modularisations et invariants des varietes de 
dimension 3. (French) Math. Ann. 316 (2000), no. 2, 215-236. 

A. Coste; T. Gannon, Remarks on Galois symmetry in rational conformal field theories. 
Phys. Lett. B 323 (1994), no. 3-4, 316-321. 

D. R. Curtiss, On Kellogg 's Diophantine Problem. Amer. Math. Monthly 29 (1922), no. 
10, 380-387. 

W. Eholzer, On the classification of modular fusion algebras. Comm. Math. Phys. 172 
(1995), no. 3, 623-659. 

P. Etingof and S. Gelaki, Some properties of finite- dimensional semisimple Hopf algebras. 
Mathematical Research Letters 5 (1998), 191-197. 

P. Etingof, D. Nikshych, and V. Ostrik, On fusion categories, Ann. of Math. (2) 162 
(2005), no. 2, 581-642. 

M. H. Freedman; M. J. Larsen; Z. Wang, A modular functor which is universal for quan- 
tum computation. Comm. Math. Phys. 227 (2002), no. 3, 605-622. 
J. Fuchs, Fusion rules in conformal field theory. Fortschr. Phys. 42 (1994), pp. 148. 

D. Gepncr, A. Kapustin, On the classification of fusion rings. Physics Letters B, 349 
(1995), no. 1-2, 71-75. 

C. Kassel, Quantum groups. Grad. Texts in Math. vol. 155, Springer- Verlag, New York, 
1995. 

E. Landau, Uber die Klassenzahl der bindren quadratischen Formen von negativer Dis- 
crimmante. Math. Ann. 56 (1903), 671676. 

S.-H. Ng, P. Schauenburg Congruence subgroups and generalized Frobenius-Schur indica- 
tors, preprint: 0806.2493vl. 

V. Ostrik, Module categories, weak Hopf algebras and modular invariants. Transform. 
Groups 8 (2003), no. 2, 177-206. 

V. Ostrik, Fusion categories of rank 2. Math. Res. Lett. 10 (2003), no. 2-3, 177-183. 
V. Ostrik, Pre-modular categories of rank 3. Mosc. Math. J. 8 (2008), no. 1, 111-118. 
E. C. Rowell From quantum groups to unitary modular tensor categories, in Contemp. 
Math. 413 (2006), 215-230. 
[18] E. Rowell, R. Stong and Z. Wang, On classification of modular tensor categories, to appear 

in Comm. Math. Phys. math.QA/0712.1377. 
E-mail address: seungmoon.hong@utoledo.edu 

Department of Mathematics, University of Toledo, Toledo, OH 43606, U.S.A. 
E-mail address: rowell@math.tamu.edu 



Department of Mathematics, Texas A&M University, College Station, TX 77843, 
U.S.A. 



